Conferencing Systems with Enhanced Capabilities 



Field of the Invention 

The present invention relates to conferencing systems. 
Background Of The Invention 

In a typical multimedia conferencing facility, a 
conference server includes a conference bridge having a 
number of ports to which participants can connect (e.g. 
by dialling up over an ISDN line or over the Internet) . 

Typically each participant will have a multimedia 
terminal which might include a video camera, display 
unit (such as a computer monitor) microphone and 
loudspeaker (e.g. as part of a telephone set connected 
to the terminal), and data transmission equipment (such 
as a computer to allow for applications such as file 
transfers, database access, electronic whiteboards) , 
all connected to the ISDN line or the Internet. 

Each participant connects to a port of the bridge and 
the conference server establishes the communications 
protocols to enable exchange of signals. Once the 
conference is underway, the conference server receives 
the multimedia stream from each participant, separates 
the channels from each stream, mixes the signals as 
appropriate and generates a return media stream to each 
participant . 

Each participant will typically be sending a number of 
channels or streams of information to the conference 



server, such as video, audio, data, and control 
signals. The conference server receives the various 
video signals and may select the signal of one party to 
be sent as an outgoing signal to all of the parties, or 
it may perform a more sophisticated mixing operation on 
the signals, such as selecting a ''current'' signal, and 
combining this with the signals from the three most 
recent '"current" signals, to generate a composite 
signal including the presence of the four most recent 
speakers, including the current speaker. 
Alternatively, and depending on the number of 
participants and available processing power, a 
composite signal of all participants may be generated 
by the server- and broadcast to each port. 

The incoming audio streams may be similarly decoded, 
mixed and re-encoded as a composite signal, or a single 
audio stream may be broadcast to all parties (i.e. the 
audio signal corresponding to the "current" video 
image ) . 

In addition to decoding, mixing, and generating audio 
and video signals, the conference server will handle 
data streams, such as file exchanges, and whiteboard 
messages . 

The conference server, in conjunction with a call 
server, also manages the connections of the 
participants to the conference, which involves 
establishing communications protocols, maintaining a 
listing of the participants' addresses and aliases (the 
address will typically be the Internet address, while 
the alias may be an email address or a name which is 
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more user friendly. Communication at this level is 
achieved by a relatively low bandwidth control channel 
or stream. 

5 Not all of the media streams need be present: thus it 
is possible to have audio and video channels only to 
and from each port, without a separate data channel, or 
the video channel may be omitted and an audio/data 
conference may be held. If some or all of the users 

10 are not computer-based, they may have telephones with 
display screens capable of displaying a reasonable 
amount of information, at least in text form. In such 
systems, the server can be arranged to provide each 
user with a listing of the users to the conference, 

15 over the control channels to the user, with that 

listing being displayed on the display screens of the 
users . 

The server may be combined with and incorporated in a 
20 switching system such as a telephone exchange or its 

multimedia equivalent or extension. Alternatively, the 
server may be coupled to but distinct from such a 
standard switching system, with the switching system 
recognising the control signals indicating a conference 
25 call request and coupling the caller to the server for 
subsequent processing of the call. 

Among the objects of the invention are the provision of 
a conference call server with enhanced capabilities, 
30 and the provision of an improved method of 
conferencing . 
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Siimmary of the Invention 

The invention provides a method of conferencing. This 
method involves (i) forming a main conference between a 
5 number of users or participant s ii ) providing a user 
with an option to request a subconf erence with some of 
the other users, (iii) forming a subconf erence between 
the user who requested the subconf erence and the subset 
of other users, and (iv) at least partially removing 
10 those users in the subconf erence from the main 
conference while the subconf erence lasts, 

A conference call (whether in audio, video, or both) 
can be regarded as a simulation of a real physical 

15 meeting at which all the participants are physically 
present. However, there is considerably more 
flexibility at a real meeting. For example, it is 
possible for some of the participants to form a private 
sub-group in which a point can be discussed privately 

20 without the other participants in the main meeting 

being involved, or participants in the conference can 
pass notes to one another. 

In a sense, these sub-groups can be regarded as 
25 subconf erences which are "off-line'' as far as the main 
conference is concerned. The invention simulates this 
behaviour in a conference scenario, by enabling users 
to request sub-meetings with some of the others 
present, to allow discussion of points privately using 
30 one or more media. 

The invention is particularly useful where the main 
conference employs a plurality of media types (such as 
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video, audio and data) , allowing users in the 
subconf erence to utilise one, some or all of these 
media types for the subconf erence, and users in the 
subconf erence can actively or passively participate in 
5 the main conference in at least one .media type during 
the subsistence of the subconf erence . 

The mix of media types in the subconf erence and the 
choice of media (if any) used to maintain a presence in 
the main conference is entirely arbitrary and can be at 
the choice of the participants. 

For example, video and audio may be used continuously 
by the main conference participants, with the option of 
data exchanges also available. A user could then 
initiate a subconf erence in data format only, so that 
text messages or files could be sent between the 
subconf erence participants but not be seen by the main 
conference participants. In terms of video and audio 
signals, the subconf erence participants would remain 
active in the main conference, but they would be 
partially removed from the main conference in the sense 
that their data exchanges would be private. 

25 A further option could arise in the full multimedia 

type of conference, where some participants take part 
in a subconf erence using video, audio and data 
exchange, all of which would be private. In such 
cases, there might be the option of the subconf erence 

30 participants monitoring proceedings in the main 

conference by continuing to receive the audio streams 
from the main conference, or of having the main 
conference video images presented to subconf erence 




participants in a window on the screen. In this way 
the current speaker in the main conference would be 
visible or audible, and the users could rejoin when a 
particular speaker begins or when a particular point is 
raised in the discussion. 

So one option is that the users in the subconf erence 
may be prevented (at their own option) from 
contributing to the main conference but remain able to 
monitor communications in the main conference during 
the subconf erence . 

Another is to allow those users in the subconf erence to 
become entirely isolated from participation in the main 
conference during the subconf erence . 

Again, these options give users the flexibility they 
would have at a real meeting, where people can leave 
the room, whisper to one another, pass notes, or move 
away from the meeting while monitoring the current 
speaker . 

The invention can be put into practice by presenting 
the users in the main conference with a list of the 
main conference participants (e.g. on their telephone 
display or computer monitor) , and allowing a user to 
request a subconf erence by selecting participants from 
the list using the computer terminal interface or 
telephone handset. The users in the subconf erence may 
then have a separate list presented to them so that 
they can see who else is in the subconf erence . 



The subconf erence list may be published" , i.e. 
presented to the main conference users, or it may be 
maintained secret, so that the other users are unaware 
of the existence of the subconf erence , depending on the 
situation. Some ways of indicating that users are in a 
subconf erence would be to highlight, "grey out'', or add 
a symbol to the names of the subconf erence participants 
in the main conference list. The sophistication of the 
display will depend on the display capabilities of the 
terminals involved . 

Preferably, the subset of user(s) to whom the request 
is initially addressed will have the option of 
accepting or refusing to join the subconf erence , and 
this acceptance or rejection determines whether or not 
each user remains as part of the subset referred to 
above . 

If the subconf erence list is published to the main 
conference participants, then the latter may have the 
option of requesting to join the subconf erence , and 
this request can be accepted or rejected by those in 
the subconf erence, or possibly at the sole discretion 
of the originator of the subconf erence . 

Furthermore, each user in the subconf erence will 
preferably have the option of leaving the subconf erence 
at any time during the subsistence of the 

subconf erence . They may then be automatically returned 
to full participation in the main conference. 

In an added degree of sophistication, users in the 
subconf erence may be presented with the option of 



8 



§11 



requesting one or more of the other subconf erence users 
to join a ''nested" subconf erence within the initial 
subconf erence . This can continue recursively, in 
theory, so that users in this sub-subconf erence can in 
5 turn request a smaller meeting. An example of the 
utility of this function would be where a conference 
occurs between representatives of two or more 
organisations. For many reasons, the users belonging 
to one team or organisation may have a private 
10 subconf erence , and at some point during this 

subconf erence, the senior members of the team might 
wish to arrive at a decision privately, in which case 
they could initiate a nested subconf erence . 

15 Another optional degree of sophistication could be 
provided by allowing a user in the subconf erence to 
initiate a new subconf erence with one or more users 
from either the main conference or the subconf erence, 
without actually rejoining the main conference. 

20 

A further alternative is the option of allowing either 
conference users or those in a subconf erence to request 
the participation of external parties. This can be 
done by having the conference server dial up the new 
25 parties, and dynamically add them to the conference or 
subconf erence . 



The creation and/or dissolution of the subconf erence 
can be specified in advance of the time of creation or 
30 dissolution. For example, in a large conference to 

which users have signed up in advance, the conference 
server may be instructed in advance to create e.g. 
three subconf erences at an appointed time, and to 
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return the participants in these subconf erences to the 
main conference at a later time. This corresponds to 
the real-life' scenario of a conference splitting into 
smaller meetings or workshops for a specified time. 
5 Participants in the conference would preferably specify 
in advance the subconf erence which they intended to 
join, or at the time of the subconf erence being 
initiated, users could be presented with the option of 
joining a particular subconf erence . 

10 

O In another aspect the invention provides a conferencing 

server having the following components: 
p i) a main conference list memory unit for maintaining 

^ a list of the users connected to the server as part of 

15 a conference, 

^ ii) a main signal processing unit for receiving 

gi incoming signals from the conference participants, 

processing these signals and generating outgoing 
p signals which are sent back to the users, 

20 iii) a main control unit for controlling both the main 
memory unit and the main signal processing unit, 

iv) a subconf erence list memory unit for maintaining a 
list of a subset of the conference participants, i.e. a 
list of participants taking part in a subconf erence , 

25 v) a subconf erence signal processing unit for 
generating outgoing signals to the subconf erence 
participants, such that the signals generated by the 
subconf erence processing unit include subconf erence- 
specific signals which are not included in the signals 

30 sent to users . who are not participating in the 
subconf erence, and 
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vi) a subconf erence control unit for controlling both 
the subconf erence memory unit and the subconf erence 
signal processing unit. 

In effect, therefore, the conferencing server of the 
5 present invention has an added degree of sophistication 
relative to conventional servers by being able to run 
subconf erences of participants from the main 
conference, while the main conference is simultaneously 
maintained. Of course, preferably two or more 
10 subconf erences can be run at the same time. 

It is preferred that the resources of the main 
Zi conference side of the server are used in the sub- 

■^Jj conferencing functions, and this allows for existing 

15 conference servers and their controlling software to be 
^ modified more easily to support sub-conferencing 

according to the invention. 

p Thus, for example, the main conference list memory unit 

y 20 and the subconf erence list memory unit can be logical 

areas within a single memory unit. 



Similarly, the functions of the main signal processing 
means and of the subconf erence signal processing means 
25 are carried out by the same signal processing unit. 

The signal processing unit is preferably adapted to 
combine signals of different media types, such as 
video, audio and data. 

30 

It is preferred that the signal processing unit should 
be dynamically programmable to generate outgoing signal 
streams containing an arbitrary combination of media 
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types selected from the incoming signals from the 
users. In this way, the subconf erence can be tailored 
not only to a user-selected group of participants, but 
also to the best combination of media for the sub- 
conference. 

The main control unit can include means for forwarding 
the list of users in the conference to each of the 
participants, to be displayed, for example on the 
handset or computer screen of each user. The users can 
then use this information to select subconf erence 
participants . 

Suppose that one user, user A, wants to set up a 
subconf erence with another user, user B. To achieve 
this, user A selects, from his display unit, user B, 
and sends to the server a subconf erence request signal 
identifying user B. This can be done using a software 
command on a desktop computer terminal, or a keypress 
combination on a telephone handset. The server sends 
the subconf erence request signal to user B, together 
with the identity of user A, and the subconf erence 
request is displayed on user B' s display unit. If user 
B accepts the request, then the server effectively 
removes users A and B from the main conference and sets 
up a private, subconf erence for them. 

In a further preferred feature, the subconf erence 
control unit has means for forwarding the list of 
subconf erence participants to the subconf erence 
participants, and optionally to all of the main 
conference participants also. 



The concept of the invention is scaleable over several 
conference servers, all interlinked and viewed as a 
single resource during the conference. Any arbitrary 
subconf erence can be constructed from the users sharing 
this resource. 

Preferably the signal processing units are part of a 
conference bridge having ports through which the 
incoming signals and outgoing signals enter and leave 
the bridge. A preferred example is a video 
conferencing bridge having multiple ports, which runs 
on software having the added functionality required to 
allow subconf erences . 

The invention also encompasses a conferencing system 
comprising a conferencing server, a call server 
connected to the conferencing server, and means for 
connecting users to the call server. The connection 
means can be e.g. a local area network: to which users 
connect, an intranet or the Internet. 

As most implementations will be software-enabled, the 
invention provides, in a further aspect, a computer 
program product containing software in machine readable 
form for managing a conference. The software, in 
operation, generates and maintains a list of 
participants in a main conference. It provides a 
participant with an option to request a subconf erence 
with a subset of other users in the list, and. when this 
option is selected and other users accept the request, 
the software will form a list of participants in the 
subconf erence . As the software manages the conference, 
it will also at least partially remove the 
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subconf erence participants from the main conference 
while the subconf erence lasts. 

When the main conference is a multimedia conference, 
5 the software will preferably not only provide users 
with the option to request a subconf erence , but will 
also allow the requesting user to select one or more of 
the media for use during the subconf erence . This 
feature allows the user to remain in the main 
10 conference in the other media. 

The invention also provides software for managing a 
conference, which can form a main conference between a 
number of users, provide a user with an option to 
15 request a subconf erence with a subset of other users, 

form a subconf erence between the user and the subset of 
other users, and at least partially remove those users 
in the subconf erence from the main conference during 
the subsistence of the subconf erence . 

20 

The invention also provides software for enabling a 
user at a terminal to participate in a conference. 
This software presents an identification of 
participants in the conference, enables the user to 
25 generate a request for a subconf erence , and forwards 
the request to a conference server to which the 
terminal is connected. 

Preferably, this software also allows the user to 
30 select one or more media types for use during the 

subconf erence . Optionally, it also allows the users in 
the subconf erence to select full duplex or half duplex 
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communications with the main conference in one or more 
media . 

Half duplex communication can be in either direction, 
5 i.e. in the case of half duplex video, the main 

conference video proceedings could be broadcast to the 
participants in the sub-conference without a return 
video stream being broadcast to the main conference 
participants, or vice versa. 

10 

In a further aspect, the invention provides a terminal 
for use in a conference, having a display unit for 
displaying the list of conference participants, input 
means for enabling a user to generating a subconf erence 
15 request with one or more of the main conference 

participants, and means for forwarding this request to 
a conference server. 

As noted above, this terminal may be a telephone 
20 handset with the required display and input 

capabilities, and having the necessary functionality to 
generate and forward the subconf erence request (either 
as a feature of software loaded on the handset or as a 
hardware feature, or it may be a multimedia terminal 
25 such as a PC having multimedia capabilities. 

In the case where the conference is a simple telephone 
conference, or where all of the subconf erence 
participants are limited to telephone connections only, 
30 the subconf erence request simply identifies the desired 
participants in the subconf erence and optionally, 
specifies whether the main conference proceedings are 
to be received by the subconf erence participants. 
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Brief List of Drawings 

The invention will now be described, by way of example 
5 and with references to the drawings, in which: 

Fig. 1 is an overview of the entities involved in a 
multimedia conference; 

10 Fig. 2 is a more detailed diagram of the entities 

involved in a multimedia conference; 

Fig. 3. is a schematic diagram of the message flows 
involved in the procedure for four terminals to 
15 join a conference in turn; 

Fig. 4. is a schematic diagram of the message flows 
involved in the procedure for a user to initiate a 
subconf erence ; 

20 

Figs. 5A-5E are simplified views of screen displays 
seen by users during the initiation of a 
subconf erence . 

2 5 Detailed Description of Preferred Embodiments 

Fig. 1 shows the general architecture of a conference 
system 10, comprising a conference server 12 and a call 
server 14 connected to a data network 15 which may be a 
30 local area network (LAN) or a wide area network (WAN) . 



In the following description, 
invention employing the H.323 



an embodiment of the 
communications standard 
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will be described, but it is to be understood that the 
invention is in no way limited to this implementation, 
which is given by way of example only. 

5 The H,323 standard is described in the Recommendation 
H.323 document published by the Telecommunications 
Sector of the International Telecommunications Union 
(ITU-T) under the title Packet Based Multimedia 
Communications Systems" . This is an umbrella for a set 
10 of standards describing equipment, terminals and 

services for multimedia conferencing over networks such 
as the Internet. 



A plurality of users are connected to the network 16 by 
Ol 15 means of telephone handsets 18 or multimedia terminals 

20. The handsets 18 have a display allowing 
conference-related information to be presented to the 
user, and the multimedia terminals are PCs with video, 
audio and data capabilities. The., handsets 18 and 
20 computer terminals 20 will be referred to collectively 
hereafter as terminals" . Such terminals are of course 
well known, and are not limited to the two types 
described above. For example, the terminal could be a 
personal digital assistant connected to the data 
25 network allowing media exchange over the network. Each 
terminal has, in addition to display capabilities, 
means for user input of commands, such as a telephone 
keypad, or a keyboard and mouse. 

30 The call server 14 comprises hardware and software 

adapted to regulate communications . between the parties 
aver the network. All terminals connecting to the 
network initially register with the call server. 
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The conference server 12 is a component having the 
necessary hardware and software to perform multimedia 
conferencing, including managing the media streams 
5 coming from the terminals, and mixing the streams which 
are output to the terminals. 

Fig. 2 shows a system generally equivalent to that of 
Fig. 1 but with greater detail. The data network 16 is 
shown as a common communication channel via which all 
other components interface directly or indirectly. A 
plurality of terminals 22a-22f (which may be telephones 
18 or multimedia terminals 20 as in Fig. 1) are 
connected to the network. 

The terminals 22 are identified as being H.323 
terminals. H.323 terminals support the H.323 standard 
and can connect directly to the switched packet network 
15, as in the case of terminals 22a, 22b and 22c, or 
connect via another switched packet network, such as 
terminal 22f which connects to the LAN/WAN network 16 
via the Internet 24, or they may dial into the network 
indirectly (as in the case of terminals 22d and 22e) 
via the public switched telephone network (PSTN) 26. 
The PSTN 26 itself requires a H.323 gateway 28 to 
connect to the network 16. 

Non-H.323 terminals could also connect via the PSTN 26 
and gateway 28. Additionally, the call server software 
30 14 contains a terminal proxy server 30, which is used 
to interface other non-H.323 based terminals to the 
call server 14. However, as such non-H.323 terminals 
would require that a proprietary signalling protocol be 
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implemented in place of H.323 signalling, they have 
been omitted for simplicity. 

The call server 14 also includes a gatekeeper component 
5 32 and a multipoint controller (MC) 34. 

The gatekeeper 32 is a H.323 entity which performs a 
number of call control services for the terminals 22a- 
22f , such as network address translation, bandwidth 
10 allocation, admission control, and accounting 
information , 

The multipoint controller 34 provides the call control 
capability to negotiate with all terminals and achieve 
15 common levels of communication. The multipoint 

controller 34 also interfaces with the conference 
server 12. 

The conference server 12 is a separate physical 
20 component in this implementation, and contains a 

further H.323 entity known as a multipoint processor 
(MP) 36. The multipoint processor 36 allows mixing, 
switching and other processing of media streams under 
the control of the multipoint controller 34. To 
25 achieve these functions, the conference server will 

include further components (not shown) , such as signal 
processing means and a memory list unit for maintaining 
a listing of the conference participants, both under 
the control of a control unit. 

30 

The multipoint processor component communicates 
directly with the multipoint controller component. In 
the traditional H.323 architecture, the multipoint 
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controller and multipoint processor combination are 
together referred to as the Multipoint Controller Unit 
(MCU) 38. 

.5 The call server 14 contains other conventional 

components 40 which are not particularly relevant to 
the present invention. 

^Fxq. 3, shows the steps involved in the procedure for 
10 four terminals 22a-22d to >^in a conference in turn. 

The message flows are sh«own as horizontal lines between 
the terminals 22a-22dy^gatekeeper 32, multipoint 
controller 34 and myltipoint processor 36, each of 
which is represen^d by a heavy vertical line. The 
15 message flows oq^ur in time sequence down the figure. 

The first terminal 22a to join the conference bridge 
logs onto the call server, by means of a series of 
Request, Admission and Status (RAS) messages 42 to and 
20 from the gatekeeper 32, as defined in ITU-T 

Recommendation H. 225.0. Gatekeeper 32 allocates 
bandwidth to the terminal and admits the terminal to 
the network. 

25 Next, the call to the conference bridge is established 
with the multipoint controller 34 by means of call set- 
up messages 44 as defined in ITU-T Recommendation 
Q.931. The parameters of the call are then established 
by means of H.245 control messages 46, which establish 

30 terminal capabilities (e.g. codec types supported, 
media types being employed, etc.). 
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The multipoint controller 34 then instructs the 
multipoint processor 36 to initiate a conference (or if 
the terminal is joining an existing conference, to add 
the terminal to the conference). The H.323 standard 
5 does not specify any mandatory requirements for the 
communication between the multipoint controller and 
multipoint processor, and in most cases, proprietary 
signalling 48 will be employed for these 

communications. Alternatively, H.248 signalling can be 
10 used. 

Once the multipoint processor 36 has added terminal 22a 
to a conference, an ongoing media stream 49 is 
established between the terminal 22a and the multipoint 
15 processor 36. This is a two way stream and may employ 
multiple media channels, such as audio, video, text and 
data or file transfer. 

Additional terminals 22b, 22c, 22d joining the 
20 . conference do so in the . same manner as terminal 22a. 
When the four terminals have joined, multipoint 
processor 36 is communicating with each terminal via a 
2-way multimedia stream 49. 

25 Multipoint processor 36 receives the incoming 

multimedia stream 49 from each terminal 22a-22d and 
processes it by separating the various media channels 
from each terminal, and mixing the signals as 
appropriate to generate an outgoing multimedia stream 

30 to each terminal. 
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Fig. 4 shows the initiation of a subconf erence using 
the same type of schematic illustration for the 
messaging as in Fig. 3. 



5 In Fig. 4, terminal 22a wishes to initiate a 

subconf erence with terminals 22b and 22c, but to 
exclude terminal 22d (and any other parties, not shown, 
who may be in the main conference) . 



lOVThe f our terminals aro^participating m a mam 

conference which em^oys a number of different media, 
as described abo^. Therefore multipoint processor 36 
is involved inytour two-way media streams 49. The user 
at terminal Zga sends a request 50 to multipoint 
15 controller to invoke a subconf erence with terminals 
22b and 2/c. 

The actual mechanism by which this is invoiced uses a 
similar mechanism to the way some other supplementary 
20 services are implemented using the ITU-T H.450 

standard. This generic functional protocol operates in 
conjunction with the call signalling protocol defined 
in H. 225 . 

■25 Although H.450 does not specify "the subconf erence 
feature, H. 450.x recommendations provide for a 
'"facility" message to request or acknowledge a 
supplementary service. The facility message has a 
user-to-user information element which can carry one or 

30 more H.450 supplementary service APDUs {Application 
Protocol Data Units - these are sequences of data 
elements exchanged between peer application layer 
entities) to invoke the subconf erence . 
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The subconf erence request 50 includes not only an 
identification of the users which are intended to be 
included, but also information regarding the media 
5 types to be used in the subconf erence, and the degree 
of continued participation in the main conference 
during the subsistence of the subconf erence , 

As an arbitrary example, assuming that the main 
conference media streams 49 are carrying voice, video, 
text, whiteboard and file transfer (FTP) data, the 
subconf erence request 50 may specify that the 
subconf erence is to be conducted in video and audio 
with a whiteboard capability. These video, audio and 
whiteboard communications between the subconf erence 
participants will therefore be hidden from the main 
conference participants . . 

The request 50 may further specify that the audio 
signal from the main conference is to be mixed in at a 
low volume level into the subconf erence media stream, 
to enable the subconf erence participants to monitor 
developments in the main conference. Furthermore, the 
request can specify the secrecy level of the existence 
of the subconf erence (i.e. the fact of the existence of 
the subconf erence may or may not be communicated to 
main conference participants). 

For simplicity and ease of use, the selection of media 
30 types, secrecy levels, and continued level of 

participation in the main conference may be set as 
defaults, although the users might have the option of 
varying the default settings in a particular case. 
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^^he multipoint controller/84 notifies terminals 22b and 
22c of the request 50 £^m terminal 22a by means of a 
request alert 52. To^inals 22b and 22c confirm or 
5 reject their participation by means of participation 

confirm message,^54. The multipoint controller 34 then 
generates a s^ibconf erence instruct message 56 to the 
mult ipoinV^rocessor 35, based on the criteria 
specifi/^ in the subconf erence request 50 and the 
10 part^i^ipation confirm responses 54 of terminals 22b, 
22^ 

In response, multipoint processor 36 creates and 
manages three new media streams 58 which constitute the 
15 signals within the subconf erence . 

Multipoint processor 36 simultaneously modifies the 
processing of the existing four main conference media 
streams 49 to take account of the alterations to the 
20 participation levels of the parties in the various 
media types within the main conference. 



Whereas the multipoint processor 36 maintains a memory 
listing of the conference participants for a 

25 conventional conference, and records the media types 
employed by the various part icipants , to enable the 
incoming media streams to be decoded and outgoing media 
streams generated, the invention necessitates that this 
functionality be expanded to take account of the 

30 dynamic changes to the participation levels of the 

users in the main conference, and to instigate the new 
media processing and participation recording of the 
subconf erence participants. This can be done within 
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the existing memory structure employed by multipoint 
processor 35, or additional memory units dedicated to 
the subconf erence feature may be employed. 

5 Each of the subconf erence users is sent a signal 

identifying the subconf erence participants on the user 
display. This information is also sent to the 
remaining main conference participants unless secrecy 
has been requested or set as default. 

^Fig. 5A shows a generic display 60 indicating to a user 
62h the identities 62a-62gyof other main conference 
participants, such as mio^t be displayed on a 
multimedia terminal 22A>t a conference participant. 
15 For each user 62a-62b^ the type of terminal employed 

(telephone handset yor multimedia) is identified by the 
icon representing/the user. 

In order to request a subconf erence , the requesting 
20 user 62h can select the desired participants 62d-62g 
with a mouse, and use a command provided in the 
conference software (e.g. on a menu or using a right 
mouse click) to call up a subconf erence request dialog 
box 64 (Fig. 5B) . 

25 

On confirming the request with the request dialog 
button 66, a media type dialog box 68 is called up 
(Fig. 5C) . The user selects the media types 70 to be 
used in the subconf erence and has the option of 
30 specifying more sophisticated options using the 

advanced button 72 to call up the advanced properties 
dialog box 74 (Fig. 5D) . 
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In the advanced properties dialog box 74, the level of 
interaction with the main conference participants can 
be selected, such as by specifying that the 
subconf erence participants continue to receive audio 
and/or video, or that the video link should be 
maintained as full duplex (so that main conference 
participants are able to see subconf erence 
participants. It also allows audio volume levels to be 
adjusted, and the degree of secrecy of the existence of 
the subconf erence chosen. Further functionality can be 
given to the user depending on the level of control 
required . 

When the requesting user completes the dialog boxes 64, 
68, 74, the conferencing software on the requesting 
user's terminal generates a request message 50 (Fig. 4) 
based on the criteria specified and sends this to the 
multipoint controller 34 which responds by sending the 
request alert message 52 (Fig. 4) to the selected users 
nominated by the requesting user. The software at the 
terminals of the selected users responds to the receipt 
of the request alert by displaying a subconf erence 
requested dialog box 76 at these terminals (Fig. 5E) . 
Selection of the accept 78 or ignore 80 buttons causes 
the terminal software to signal the response in a 
participation confirm message 54 (Fig. 4), following 
which the subconf erence is initiated as described 
herein . 

The present invention is not confined to multimedia 
conferences. It also has applicability in simple 
telephone conferences where the users each have a 
handset having the capability of allowing users to 
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select other users in the conference as part of a 
subconf erence request . 

In any conference, a conference server of some sort 
(which may be a switchboard having conferencing 
facilities) will control the signal processing. The 
invention requires that the server have means for 
creating a virtual conference within the main 
conference. The server will generate a subconf erence 
memory list for use in managing the signals originating 
from the subconf erence users, and will have the 
capability of processing the signals from the 
subconf erence users differently to those from the main 
conference participants who are not in the 
subconf erence . Effectively, what is required of the 
server is that it the signal processing means can 
generate outgoing subconf erence signals which have 
information which is private to the subconf erence 
participants, i.e. which is not included in the main 
conference signals sent to users outside the subset of 
subconf erence participants . 



